Mutual Information and Topology 2: Symmetric Network
نویسندگان
چکیده
Following Gardner [1], we calculate the information capacity and other phase transition related parameters for a symmetric Hebb network with small word topology in mean-field approximation. It was found that the topology dependence can be described by very small number of parameters, namely the probability of existence of loops with given length. In the case of small world topology, closed algebraic set of equations with only three parameters was found that is easily to be solved.
منابع مشابه
Efficient computation of MMI neural networks for large vocabulary speech recognition systems
This paper describes, how to train Maximum Mutual Information Neural Networks (MMINN) in an efficient way, with a new topology. Large vocabulary speech recognition systems, based on a Hybrid MMI/connectionist HMM combination, have shown good performance on several tasks [1] and [2]. MMINNs are trained to maximize the mutual information between the index of the winning output neuron (Winner-Take...
متن کامل2 a Proof of Regularity of the Embedding
The topology of the embedding of the coadjoint orbits of the unitary group U(H) of an infinite dimensional complex Hilbert space H, as canonically determined subsets of the B-space Ts of symmetric trace class operators, is investigated. The space Ts is identified with the B-space predual of the Lie-algebra L(H) s of the Lie group U(H). It is proved, that orbits consisting of symmetric operators...
متن کاملLink Prediction in Complex Networks: A Mutual Information Perspective
Topological properties of networks are widely applied to study the link-prediction problem recently. Common Neighbors, for example, is a natural yet efficient framework. Many variants of Common Neighbors have been thus proposed to further boost the discriminative resolution of candidate links. In this paper, we reexamine the role of network topology in predicting missing links from the perspect...
متن کاملAn Efficient Mutual Authentication and Access Control Scheme for Wireless Sensor Networks in Healthcare
Wireless sensor networks (WSNs) will play an active role in the 21th Century Healthcare IT to reduce the healthcare cost and improve the quality of care. The protection of data confidentiality and patient privacy are the most critical requirements for the ubiquitous use of WSNs in healthcare environments. This requires a secure and lightweight user authentication and access control. Symmetric k...
متن کاملAn information theoretic scoring function in belief network
We proposed a novel measure of mutual information known as Integration to Segregation (I2S) explaining the relationship between two features. We investigated its nontrivial characteristics while comparing its performance in terms of class imbalance measures. We have shown that I2S possesses characteristics useful in identifying sink and source (parent) in a conventional directed acyclic graph i...
متن کامل